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1. This action is responsive to Amendment filed on September/ 14/2004. 

2. Claims 17-52 are presented for examination. Claims 1-16, 33, and 39 have been canceled. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claim 17-32, 34, 38, 40, 44-46, 47, 49 and 51-52 are rejected under 35 U.S.C. 103 (a) as 
being unpatentable by applicant submitted EDS issued to 1999 IEEE Shadow Gestures: 3D Hand 
Pose Estimation using a Single Camera in view of Easty et al. (USPN: 6,448,987) hereinafter 
Easty. 

As per claims 17 (method), 24 (device), and 52 (user interface); Shadow Gestures 
discloses a method for recognizing a selection a set of at least two alternatives as the technique 
of moving the thumb and the index finger (see page 484, right col., lines 1-2), the method 
comprising: 

Determining the positions corresponding to each alternative in the space surround a user 
on the basis of their distance and direction with respect to the user so that the locations of the 
positions remain substantially the same with respect to user irrespective of the location of the 
user is taught by Shadow Gestures as the technique of an input interface to applications that 
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require multi-dimensional control (see page 479, left col., lines 57-58) wherein a light source to 
cast the shadow of a hand and use a single camera to image both the hand and its shadow. 
Features derived from projections of the hand and the shadows are then used to compute 3D 
position and orientation (see page 479, right col., lines 17-21) and the geometry of the shadow 
formation calculation (see page 483, left col., line 23 to right col., line 39 and see Fig. 7); 

Allowing the user to carry out a first movement for moving a member of the body to a 
position corresponding to an alternative the user desires is taught by Shadow Gestures as the 
technique of user controls the robot arm by moving the thumb (see page 484, right col., line 1); 

Recognizing a second movement carried out by the user in the position corresponding to 
the alternative the user desires is taught by Shadow Gestures as the technique of user controls the 
robot arm by moving the thumb and the index finger (see page 484, right col., lines 1-2); 

In response to the second movement, recognizing the selection the user desires as 
completed is taught by Shadow Gestures as the technique of selecting simple primates from a 
menu and manipulating them (see page 484, left col, lines 50-51 and see Fig. 8); 

Providing the recognizing selection as an output is taught by Shadow Gestures as 3D 
Scene in Fig. 8; 

Shadow Gestures, however, does not disclose the limitation of wherein said positions are 
sectors on an arcuate area and first movement comprises moving the member of the body to a 
certain sector on said arcuate area. 

Easty discloses the limitation of wherein said positions are sectors on an arcuate area and 
movement comprises moving the member of the body to a certain sector on said arcuate area as 
the technique of the main feature of menu structure for the GUI comprises two or more 
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concentric rings each representing a level of the menu item system . Each menu ring comprises a 
plurality of icons identifying the menu item. The icons on an outer menu ring represent the 
categories of digital contents offered through the digital content delivery system, such as 
television, movies, music or the like (see col. 2 line 62 to col. 3 line 1), in the illustrated 
embodiment, the icons 1 la and 12a on each menu ring 1 1 and 12 have arcuate shapes of 
substantially equally spaced along the respective circles (see col. 4, lines 29-32), and when an 
icon 1 la is selected from the outer ring 1 1, in addition to rotating the outer ring to the new 
setting, the inner ring 12 is displayed with appropriate icons identifying the available 
subcategories associated with the selected category . For example, if the "music" category is 
selected from the outer ring 1 1, the icons displayed on the inner ring will include rock, classical, 
top 40, Jazz (see col. 5, lines 45-51 and see Fig. lb). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was make to include Easty's teaching of wherein said positions are sectors on an 
arcuate area and movement comprises moving the member of the body to a certain sector on said 
arcuate area into that of Shadow Gestures' invention. By doing so, the system would be 
enhanced by capable of characterizing digital content and its hierarchically associated 
information into different classes and thus allowing those digital contents delivery to an end user 
based on user's selection. 

As per claim 45 (system), due to the mostly similarity of this claim to that of claim 17 
(method), except for the system comprising: a central processing unit, a three dimensional 
display device, the central unit comprising communication means for communicating positions 
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corresponding to selection alternatives to the three dimensional display device are taught by 
Shadow Gestures as the techniques of our system operates at 60 HZ on a SGI Indy (see page 
479, right col., line 40) to compute 3D position and orientation (see page 479, right col., line 21) 
for the user control up to seven parameters (gripper's position, orientation and jaw-separation) by 
natural finger movement (see page 479, left col, lines 20-22). This claim is therefore rejected for 
the reasons as set forth above. 

As per claims 18 (method) and 25 (device), the limitation of indicating to the user at least 
once the positions corresponding to the alternatives as showing virtual images in each position is 
taught by Shadow Gestures as the technique of virtual fly-thru 5 s over terrains (see page 484, 
right col., lines 7-8 and see Fig. 9). These claims are therefore rejected for the reasons as set forth 
above. 

As per claims 19 (method) and 26 (device), the limitation of demonstrating to the user the 
alternative indicated at any given time is taught by Shadow Gestures as the technique of real- 
time gesture recognition and hand tracking system that can be used as input interface to 
applications that require multi dimensional control (see page 479, left col., lines 26-29). These 
claims are therefore rejected for the reasons as set forth above. 



As per claims 20 (method) and 27 (device), the limitation of recognizing the second 
movement contactlessly is taught by Shadow Gestures as the technique of virtual fly-thru's over 
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terrains (see page 484, right col., lines 7-8 and see Fig. 9). These claims are therefore rejected for 
the reasons as set forth above. 

As per claims 21 (method) and 28 (device), the limitation of wherein the first movement 
is the movement of the user's hand is taught by Shadow Gestures as the technique of user 
controls the robot arm by moving the thumb and the index finger (see page 484, right col., lines 
1-2). These claims are therefore rejected for the reasons as set forth above. 

As per claim 22 (method), the limitation of carry out the first function to the output is 
taught by Shadow Gestures as the technique of controlling robot arm by moving the thumb (see 
page 484, right col., lines 1-2 and see 3D Scene in Fig. 8). This claim is therefore rejected for the 
reasons as set forth above. 

As per claim 29 (device), the limitation of carrying out a first function in response to the 
second movement is taught by Shadow Gestures as the technique of controlling robot arm by 
moving the thumb and index finger (see page 484, right col., lines 1-2 and see 3D Scene in Fig. 
8). This claim is therefore rejected for the reasons as set forth above. 

As per claims 23 (method) and 30 (device), the limitation of allowing the user to carry 
out certain second activity with a specific third movement of the member of the body is taught 
by Shadow Gestures as the technique of an interface to 3D video games where users can navigate 
by finger-pointing. The user can also fire guns using the "click" gesture and open doors with the 
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" reach" gesture (see page 484, right col, line 12 to page 485, left col, line 2). These claims are 
therefore rejected for the reason as set forth above. 

As per claim 3 1, the limitation of recognizing the second movement carried out by the 
user in the position are adapted to be attached to the user is taught by Shadow Gestures as the 
technique of user controls the robot arm by moving the thumb and the index finger (see page 
484, right col., lines 1-2) for selecting simple primates from a menu and manipulating them (see 
page 484, left col., lines 50-51) of 3D video games (see page 484, right col., line 13). This claim 
is therefore rejected for the reason as set forth above. 



As per claims 32 (device) and 46 (system), Shadow Gestures discloses the invention 
substantially as claimed above. Shadow Gestures, however, do not disclose the limitation of 
wherein the device comprises at least one of the following: mobile station, a computer, a 
television apparatus, a data network browsing device, an electronic book, and an at least partly 
electronically controlled vehicle. 

Easty discloses the limitation of wherein the dice comprises a computer, a television 
apparatus, an electronic book as the technique of categories of digital contents offered through 
the digitl content delivery system , such as television, movies, softwares, books, music or the like 
(see col. 2 line 66 to col. 3 line 1 and see Fig. la). 

It would have obvious to one having ordinary skill in the art at the time the invention was 
made to include Easty' s teaching of digital content delivery system into that of Shadow Gestures 
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invention. By doing so, the system would be enhanced by capable of connecting a device to 
digital contents information and allowing user to select content based on user desired manner. 



As per claims 38 (method) and 44 (device), the limitation of determining the positions 
corresponding to each alternative in the space surrounding a user also on the basis of their 
distance with respect to the user is taught by Shadow Gestures as the technique of a light source 
to cast the shadow of a hand and use a single camera to image both the hand and its shadow. 
Features derived from projections of the hand and the shadows are then used to compute 3D 
position and orientation (see page 479, right col., lines 17-21) and the geometry of the shadow 
formation calculation (see page 483, left col, line 23 to right col., line 39 and see Fig. 7). These 
claims are therefore rejected for the reasons as set forth above. 

As per claim 47, the limitation of recognizing is a camera is taught by Shadow Gestures 
as the technique of we presented a one camera system that recognizes three gestures and tracks 
the user's hand (see page 485, left col., lines 31-32). This claim is therefore rejected for the 
reasons as set forth above. 

As per claims 34 (method), 40 (device), and 49 (system); Shadow Gestures discloses the 
invention substantially as claimed above. Shadow Gestures, however, does not disclose the 
limitation of wherein arcuate area is selection disc. 
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Easty discloses the limitation of wherein arcuate area is selection disc as the technique of 
the main feature of menu structure for the GUI comprises two or more concentric rings each 
representing a level of the menu item system . Each menu ring comprises a plurality of icons 
identifying the menu item. The icons on an outer menu ring represent the categories of digital 
contents offered through the digital content delivery system, such as television, movies, music or 
the like (see col. 2 line 62 to col. 3 line 1). 

It would have obvious to one having ordinary skill in the art at the time the invention was 
made to include Easty' s teaching of wherein arcuate area is hierarchical selection menu disc into 
that of Shadow Gestures' invention. By doing so, the system would be enhanced by capable of 
allowing user option to select any desired menu item in the multi levels concentric menu based 
on user desired. 

As per claim 50, the limitation of wherein the three dimensional display device and the 
means for recognizing are comprised in the same unit is taught by Shadow Gestures as the 
technique of we presented a one camera system that recognizes three gestures and tracks the 
user's hand in 3D (see page 485, left col., lines 3 1-32). This claim is therefore rejected for the 
reasons as set forth above. 

5. Claim 48 is rejected under 35 U.S.C. 103(a) as being unpatentable over in view of 
applicant submitted IDS issued to 1999 IEEE Shadow Gestures: 3D Hand Pose Estimation using 
a Single Camera in view of Easty et al. (USPN: 6,448,987) hereinafter Easty and further in view 
of Kumar et al. (USPN: 6,624,833) hereinafter Kumar. 
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As per claim 48, Shadow Gestures- Easty disclose the invention substantially as claimed 
above. Shadow Gestures- Easty, however, do not disclose the limitation of wherein the means for 
recognizing is a shape tape. 

Kumar discloses the limitation of recognizing is a shape tape as the technique of the 
system 10 can of course be utilizing with other types of information processing devices (see col. 

5, lines 33-34). 

It would have obvious to one having ordinary skill in the art at the time the invention was 
made to include Kumar's teaching of recognizing is a shape tape into that of Shadow Gestures- 
Easty combined invention. By doing so, the system would be enhanced by capable of allowing 
user to select shape tape device for recognizing and recording user movement in virtual 
environment. 

6. Claims 35-37, 41-43 are rejected under 35 U.S.C. 103(a) as being unpatentable over in 
view of applicant submitted IDS issued to 1999 IEEE Shadow Gestures: 3D Hand Pose 
Estimation using a Single Camera in view of Easty et al. (USPN: 6,448,987) hereinafter Easty 
and further in view of Selker (USPN: 6,549,219). 

As per claims 35 (method) and 41 (device), Shadow Gestures-Easty disclose the 
invention substantially as claimed above. Shadow Gestures-Easty, however, do not disclose the 
limitation of the first movement is a substantially horizontal movement of the hand to a certain 
sector of an arcuate area situated substantially in horizontal plane . 
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Selker discloses a certain sector of an arcuate area situated substantially in horizontal 
plane as the technique of a multiple level pie menu. As with the concentric menu system of Fig. 
1, the menus are separate into multiple levels of importance. However, in this concentric level 1 
is split into multiple menu selections 11, 12, 13, and 14 (see col. 3, lines 44-48 and see Fig. 2). 

It would have obvious to one having ordinary skill in the art at the time the invention was 
made to combine the teaching of the first movement is a substantially horizontal movement of 
the hand introduced by Selker into that of Shadow Gestures-Easty combined invention. By doing 
so, the system would be enhanced by capable of allowing user option to perform stretch out 
movement of the thumb and select any desired menu item in the pie menu based on user 's 
desired manner. 

As per claims 36 (method) and 42 (device), Shadow Gestures-Easty disclose the 
invention substantially as claimed above. Shadow Gestures-Easty, however, do not disclose the 
limitation of the second movement is a substantially vertical movement of the hand at said 
certain sector. 

Selker discloses the limitation of certain sector as the technique of a pie menu wherein 
highest popularity based on a historical analysis is placed in the level 1 circle 10. Level 2 
receives a secondary menu item 20 of less importance (see col. 3, lines 39-41 and also see Fig. 

i). 

It would have obvious to one having ordinary skill in the art at the time the invention was 
made to combine Selker teaching of the second movement is a substantially vertical movement 
of the hand into that of Shadow Gestures-Easty combined invention. By doing so, the system 
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would be enhanced by capable of allowing user option to perform fly through movement of the 
hand and select any desired menu item in the pie menu based on user desired manner. 

As per claims 37 (method) and 43 (device), Shadow Gestures discloses the invention 
substantially as claimed above. While Shadow Gestures discloses the second movement as the 
technique of the user stretches out the thumb and the pointing finger and initiates flying by 
moving the hand (see page 484, right col., lines 8-10). Shadow Gestures, however, does not 
disclose the limitation of the second movement is placing a hand into a certain position at said 
certain sector. 

Easty discloses the limitation of placing a hand into a certain position at said certain 
sector as the technique of when an icon 1 la is selected from the outer ring 1 L in addition to 
rotating the outer ring to the new setting, the inner ring 12 is displayed with appropriate icons 
identifying the available subcategories associated with the selected category. For example, if the 
"music" category is selected from the outer ring 1 1, the icons displayed on the inner ring will 
include rock, classical, top 40, Jazz (see col. 5, lines 45-51 and see Fig. lb). 

It would have obvious to one having ordinary skill in the art at the time the invention was 
made to combine Easty teaching of user selection into that of Shadow Gestures' teaching of the 
second movement invention. By doing so, the system would be enhanced by capable of allowing 
user option to perform second movement and select any desired menu item in the pie menu based 
on user's desired manner. 

7. Claim 5 1 is rejected under 35 U.S.C. 103(a) as being unpatentable over in view of 
applicant submitted IDS issued to 1999 IEEE Shadow Gestures: 3D Hand Pose Estimation using 
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a Single Camera in view of Easty et al. (USPN: 6,448,987) hereinafter Easty and further in view 
of applicant submitted IDS issued to Tomi Engdahl,1999: 3Dglasses and other 3D display 
device. 

As per claim 51, Shadow Gestures-Easty disclose the invention substantially as claimed 
above. Shadow Gestures-Easty, however, do not disclose the limitation of the three dimensional 
display device is virtual glass. 

Engdahl disclose the limitation of the three dimensional display device is virtual glass as 
the technique of the 3D material can be stored to any standard color video media and viewed 
with normal display devices as long as you wear the right color filter glasses (see page 1, lines 
30-31). 

It would have obvious to one having ordinary skill in the art at the time the invention was 
made to include Engdahl 5 s teaching of virtual 3D glass into that of Shadow Gestures-Easty 
combined invention. By doing so, the system would be enhanced by capable of allowing user to 
use 3D virtual glasses for viewing color video media. 

8. Applicants' arguments filed on September/14/2004 have been fully considered, but they 
are not persuasive. 

On page 12, second to fourth paragraphs, Applicants argues that " Amended claim 17 
reads: "said positions in the space surrounding a user are sectors on an arcuate area". Other 
independent claims 24, 45 and 52 have corresponding limitation. Shadow Gestures relates to 
multi-dimensional control and does not disclose even an arcuate area surrounding the user or 
sectors of such arcuate area as different positions corresponding to different alternatives". The 
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Examiner agree that Shadow Gestures lacks of the teaching of "sectors of such arcuate area as 
different positions corresponding to different alternative", however, the limitation of "sectors of 
such arcuate area as different positions corresponding to different alternative" is taught by newly 
found art issued to Easty (USPN: 6,448,987) as the technique of main feature of menu structure 
for the GUI comprises two or more concentric rings each representing a level of the menu item 
system . Each menu ring comprises a plurality of icons identifying the menu item. The icons on 
an outer menu ring represent the categories of digital contents offered through the digital content 
delivery system, such as television, movies, music or the like (see col. 2 line 62 to col 3 line 1), 
in the illustrated embodiment, the icons 11a and 12a on each menu ring 1 1 and 12 have arcuate 
shapes of substantially equally spaced along the respective circles (see col. 4, lines 29-32), and 
when an icon 1 la is selected from the outer ring 1 1, in addition to rotating the outer ring to the 
new setting, the inner ring 12 is displayed with appropriate icons identifying the available 
subcategories associated with the selected category . For example, if the "music" category is 
selected from the outer ring 11, the icons displayed on the inner ring will include rock, 
classical, top 40, Jazz (see col. 5, lines 45-51 and see Fig. lb). Thus different alternatives could 
presented to an end user based on user's selection. 

On the fifth paragraph of page 12, Applicants argue that " Shadow Gestures does not 
discloses making a selection or interpreting user's commands on the basis of the position of a 
member of the body in the area surrounding the user; position herein meaning location or place 
of the member of the body in the area surrounding the user". The Examiner, however, does not 
agree to this argument since this limitation is taught by Easty as the technique of when an icon 
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11a is selected from the outer ring 11, in addition to rotating the outer ring to the new 
setting, the inner ring 12 is displayed with appropriate icons identifying the available 
subcategories associated with the selected category . For example, if the "music" category is 
selected from the outer ring 11, the icons displayed on the inner ring will include rock, 
classical, top 40, Jazz (see col. 5, lines 45-51 and see Fig. lb). Thus different alternatives of 
digital contents information of Movies, Software, Videos, Music, Book, Television, Style could 
presented to an end user based on user's selection. 

On the second paragraph of page 13, Applicants agues that " Thus the rejection of claims 
17-31, 38, 44-45, 47 and 51 under 102 on Shadow Gestures should be withdrawn". The 
Examiner, however, does not agree to this argument. The claims (17-31, 38, 44-45, 47 and 51) 
are therefore rejected for at least of the reasons as set forth above over Shadow Gestures in view 
ofEasty. 

On the fourth paragraph of page 13, Applicants ague that " Kumar fails to disclose the 
above features. Thus combining it with Shadow Gestures does not result in the claimed 
invention. Thus claims 32, 46 and 48 are unobvious under 35 USC 103 on this reference 
combination.". The Examiner, however, does not agree to this argument since as indicated by the 
Examiner: Shadow Gestures discloses above features with respect to claim 17 above. Shadow 
Gestures does not disclose the limitation of wherein the device comprises at least one of the 
following: mobile station, a computer, a television apparatus, a data network browsing device, an 
electronic book, and an at least partly electronically controlled vehicle. 
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Easty discloses the limitation of wherein the dice comprises a computer, a television 
apparatus, an electronic book as the technique of categories of digital contents offered through 
the digitl content delivery system , such as television, movies, softwares, books, music or the like 
(see col. 2 line 66 to col. 3 line 1 and see Fig. la). 

It would have obvious to one having ordinary skill in the art at the time the invention was 
made to include Easty' s teaching of digital content delivery system into that of Shadow Gestures 
invention. By doing so, the system would be enhanced by capable of connecting a device to 
digital contents information and allowing user to select content based on user's desired manner. 

On the fifth paragraph of page 13 to the first paragraph of page 14, Applicants argues that 
"The Examiner states that Selker discloses that the positions are sectors on an arcuate 

area Shadows Gestures discloses neither positions nor locations surround the user. Therefore, 

the combination of Shadow Gestures and Selker does not lead to having alternatives as positions 
in the space surrounding a user, wherein the positions are sectors an arcuate area as presently 
claimed". The Examiner, however, does not agree to these arguments for at least of the following 
two reasons: 

First of all, the limitation of "the positions are sectors on an arcuate area" presented by 
Applicants from claims 33 and 39 are now have been canceled in response to the Amendment 
filed on September/14/2004. 

Secondly, the limitation of "the positions are sectors on an arcuate area" wherein "positions are 
in the space surrounding a user" are taught by Easty as the technique of the main feature of menu 
structure for the GUI comprises two or more concentric rings each representing a level of the 
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menu item system . Each menu ring comprises a plurality of icons identifying the menu item. 
The icons on an outer menu ring represent the categories of digital contents offered through the 
digital content delivery system, such as television, movies, music or the like (see col. 2 line 62 to 
col. 3 line 1), in the illustrated embodiment, the icons 11a and 12a on each menu ring 11 and 
12 have arcuate shapes of substantially equally spaced along the respective circles (see col. 
4, lines 29-32), and when an icon 1 la is selected from the outer ring 1 1, in addition to rotating 
the outer ring to the new setting, the inner ring 12 is displayed with appropriate icons identifying 
the available subcategories associated with the selected category . For example, if the "music" 
category is selected from the outer ring 1 1, the icons displayed on the inner ring will include 
rock, classical, top 40, Jazz (see col. 5, lines 45-51 and see Fig. lb) and when an icon 11a is 
selected from the outer ring 11. in addition to rotating the outer ring to the new setting, the 
inner ring 12 is displayed with appropriate icons identifying the available subcategories 
associated with the selected category . For example, if the "music" category is selected from 
the outer ring 11, the icons displayed on the inner ring will include rock, classical, top 40, 
Jazz (see col 5, lines 45-51 and see Fig. lb). Thus different alternatives of digital contents 
information of Movies, Software, Videos, Music, Book, Television, Style could present to an end 
user based on user's selection. 

On the second paragraph of page 14, Applicants argue that " Thus the rejection of claims 
33-37, 39-43 and 49 under 35 USC 103 on this combination of references should be withdrawn". 
The, Examiner, however, does not agree to this argument. These claims (34-37, 40-43 and 49) 
are therefor rejected for at least of the reasons as set forth above. 
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On the third paragraph of page 14, Applicants argue that " Similarly, Engdahl fails to 
discloses the above features. Hence combining it with the above references does not result in the 
presently claimed invention. Thus, the rejection of claim 51 under 35 USC 103 on Shadow 
Gestures, Kumar and Engdahl should be withdrawn". The Examiner, however, does not agree to 
this argument. This claim 5 1 is rejected for at least of the reasons as set forth above over Shadow 
Gestures in view of Easty and further in view of Engdahl. 

On the first paragraph of page 15, Applicants indicated that " new claim 52 directed to a ^ 
user interface has been added. The subject matter of this new claim corresponds to subject matter 
of device claim 24. Therefore the Examiner should also take this new claim into consideration at 
this stage. ".The Examiner, however, does not agree to this argument since this claim has been 
rejected for the same reasons applied to claims 17 and 24 as set forth above over Shadow 
Gestures in view of Easty. 

Conclusion 

9. A shortened statutory period for reply to this action is set to expire THREE MONTHS, 
ZERO DAYS from the mailing date of this action. Failure to respond within the period for 
response will cause the application to be abandoned. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to CUONG T THAI whose telephone number is (571) 272-4056. 
The examiner can normally be reached on 8:00 am - 4:00 pm. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John W. Cabeca can be reached on (571) 272-4048. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



CUONG T THAI 
Examiner 
Art Unit 2173 



January/26/2005. 




